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The/ Performance Funding Project o'f the Tennessee 
Higher Education- Commission to improve the current appropriations 
formula iji Tennessee -is discussed, and abstracts regarding pilot . 
imple men tuition of the proiect at four institutions arc presented, tA 
major project objective is to explore- ^he feasibility of allocating 
• ^ojne portion of state ^unds.on a performance criterion, as compared 
' to allocating fun'dd eolely on an enrollmient criterioh. It Is a^s^amed ' 

that funding will continue to be primarily 'baeed on enrollment, but' 
Othat a complementary featti^re might be built into th* formula to 
•promote institutional divet«ity and improved instructional -'^ 
performance, puring the f:irst^prp ject /ehr^ faculties at *1 4- Ten pes see 
institutions developed institutional- nide instructional- goals and 
. associated indicators for measuring performance on thoj^e gdals. The 
'second p^iroject year involved 'collecting data on the indicators and 
exploring ¥ays in which project results, might be id.n?5otpQrat^d into 
tine allocation process* Indicator profile;!? tr© included for the 
,Collowing four colleges: Columbia gta^e C«H!i»unity college. The 
University of Tennessee at 'Knoxvillec, The ani v©r$ity of Tennessiee at 
flartin, and. The University^ of ^Tipnnessee at Sashvi?,ler Observations . 
: |>aaed on ^e pUot projects are -presented. An ")S!V^|.uation Networic 
IJeifslettei^ article on evaluation. in higher^ education, fit the. 
. depart mental and program level its 'at)p ended, (S«j ' ^ 
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. When one go^ tot a f%ical exam'lpatlo;.. the physician doesn't 
ch«ck "health." The phyVoian inatead monitors « sarioa- of physiological . 
maicatots co'llectlveiy allowing soma asaassmant of W atata of health. 
Wkewlse the "atate of health" of a aoalal unit may be fout/d In aplde^ologlcal 
data on mortillty, morbidity, disability, etc. . ' ' 'H' ' 

■ What, la thi promise of ,a profile of educational Indicators in pr'esefltlng . 
,a picture of the condition of higher education? Good conceptual work 

exists from several sources. Publications of the Kational Cente/«or,^...---- 
Educational Statistics -(NCES) provide Interesting' displays of educa- 
tional indlctors.l Recent work of the national tenter for Higher Edu^^ 
cation Management Syste-^ (NCHEMS) . also makes a valuable contribution. ^ 
Classification approaches, such as that suggested by Cooler, ale also 

* 

useful.^ * - 

The acceptability of this work at the campu., level, ,however, remains 

e question mark. Mahy -c^pus observers Slfe uneasy about the potential 

development of educatlonal'performance^lndicators, especially 4t the 

state level.^lewing this as a continuation of a "leveling;' (or "meddling") 

influence -that began with Statewide fusing formulae for piiblic^^lnstitu- _ 

t±ot£. • ' ■ "^^ ' W ' 

, • ms report, profiles a statewide .pa^e«hiP:^"ort in the development 
of performance Indicator* J^^MSfr education. It Ig a report of eleven 
■ Tennessee publlt institutions-universjttles and communlt.y colleges- 
^ working to Identify perf«r^ncc lndicato\ref l^ing .their institutional 

■ „is.lon, to acquire daH on those indlcafg^, make public the^results, 
aAa to act on those result, for the Improvement of Instructlot!.^ . 
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This paper centers on, performance indlcatotQ, but l%V;;6ulld8 oa a 
larger effort known as tha Per^rtrma1aco Funding "Project, The Performance 
Funding Project represents an dittempt the Tennessee Higher Education, j - 
/Commlsaiou to Improve the current ri^propriatlonis formula in Teionessoe. 
The project assumes state funding i^lll continue to nest primarily on an v 
enrollment basis, but that a' complemct>tary feature i^ghti be built Into 
the formula to .promote ins' true tional effectiveness, CampuS-based pilot , 
projects provide^he vehicle for ex^oring this posaiblllty. The Commiagion 
Initiated these projects through ^ call for proposals and provl<|ed support 
through grants from the Kellogg Foundat^Lon, the Ford Foundat^^oti^ and the 
Fund for. the Improvement of Postsecopdary Education. Last year, faculties 
at eleven Tennesaee lyistltutions developed instltutlonal-xolde Ins tructiohal 
goals and associated indicators for measuring performance on those goals^ 
Pilot project activity this year involves collecting data on those in-- 
dicators and epqplpring ways in vhich project results might be incorporated* 
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Into the allocation process: 
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Case Illustrations - Diversity^ Withi n Community 

Attachment A Includes abstracts of the indicator profiles for four 
institutions: Colvunbla State Community College, The University of Tennessee 
at JCnoxville, The University of Tennessee at Ma^in, and The University 
of Tennessee at Nashville. ^ These abstracts Illustrate the kind of work 
completed at dll eleven institutions at the end of the first project; , 
year.' These abstracts are taken from larger reports available from each 
partlqipating institutions. Even a review a limited number of project 
abstracts, however, provides som6. Interesting observations* \v>j 
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Flr at o f _^ljljnve_j[>ro^ , reveal that jnanjr 

projectH take ^jftfl^^tmtage^ ^^^^ a pleasant recog- 

nitloii of the conceptual work completed by such agencies as NCIIEMS, KTS, 

- • . ^ • / • . ' ^ . ; 

and ACT* The array of campus Indlcatorjg^ .lucl udes a distrlbullou of 
readily-available Insttuments and indicators' and those developed. at the 
campus level. Thus, campus projects for the most part avoid "relxivent ing 
the Indicator wheel » 

Second, the a^c goal and Indicator profiles clearly express Institu^ 
tlonal diversity, wfille many Institutional goals have a common character, 
the Indicators chosen represent dlffercncjes in institutional choice as' 
to what measures best represent an institution's public performance on 
those goals. 

J^iZj-i ljj!L-^Jij:^-^^-^9T^ indicato rs reveals the villinRness of campuses 
S to rlsk ^ Note s/hould be taken of planned participation in at least two 
experimental ventures — the College putcome Measures Project being 
developed at ACT and the General Education; Outcome Project being developed 
by ETS. 

A. 

Finally, the project presents the p ossibility of bridging the gap 
between public accountability §n<i institutional/faculty autonomy. While 
Institutional faculties grow uneasy with tW? Increasing interest of ex- 
ternal agencies in campus affairs, public interest iu higher education 
accountability continues undiminished. The goals and Indicators developed 
by the various pilot projects clearly demonstrate that institutions can 
satisfy public accountability concerns and simultaneously express their 
' uiilgue character. 
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Kvaluat ion A Modest St-(nm1u:s Wi(h A Ul^ Rrfipottsr 

Otrfier conclusions emerge from an analysis of these indicator profile.^ 
and the work loading to their de</elopment • The following outline suggests 
several "lessonfi^earned*' and •'rromislng findings/' 

Lesso n ffl. Most campuses Ident If led a relatively large number of 

ludlcatoro. Realizing that any single Indicator can be crltlc^Kcd 

) 

an Inadequate reflection of Inst ruct loual performance, pilot pipojccts . 
attempt to assess performance by focusing severial indicators on the 
sanm goal- In som<^ cases, however, the burden of evaluation created by 
a large number of indicators suggests limiting work to a few well-chosen 
Indicators. k 

Lesson j?2 . Campus personnel are concerned institutions wi^h an 

apparent richness of conceptual expertise might fair better — the 

■ " ^ "~ ~ ~" ) 

, idea that the "big" canr,)-3 already rich in resources will win out over 

the "smaller" .campus in any performance competition. The performance 
record of the pilot projects thus far is encouraging us however since 
community college appear to be developing some our best projects.^ 

Lesson The possibility of statewide indicators of institutional 

performance is disturbing to campus personnel.' Early In the project the 
possibility of developing a set of statewide indicators that all institu- 
tions could be assessed against was discussed. One cami^s administrator 
pointed out, though, that; statewide indicators of performance "average out 
institutional idefitity Just the current formula supposedly does, since 
every institution would be assessed by a compon standard.' 



LcBiion While caropuyes arc'reluctant to-qonsidcr statewide per- 

formance Indicators, they are cqualjy Kusplciou.o of carainus-basod Indicators. 
Ihis. ousplclon grown partly out of a concern that campus-developed indicators 

1 

wl\l no f be .equally rlgt>rou8 across Institutions. One faculty conmiltteo. . 

working on the Pt-rf ormai^ce jFundlng Project asked why they ^liotjld develop 

' - .. . ' ■ ■ ■ . ' .. _ 

rigorous Instructional goals when another institution might select a • 

"straw-man" approach to goal setting and be rewarded more for less achieve- 
ment. Suspicion also grows Out of a concern that one department or college 
be singled out, as solely responsible for certain instructional gjoals or 
outcomes, e.^., English department for conpnunicdtion competencies^ philQSO- 
jihy department for critical thinking competencies. 

Lesson ff5. Getting faculty to think in terms of institutional-wide 

^ — -~ - - • 

goals and indicators .is difficult. Individuals s^eak with case about 
departmental .goals and indicators but ax'riving at goals and indicators 
that cut; across departmental lines is another matter. 

Lesson' OG, Our 'desire for institutional-Wide instructional performance 
measures is running a> little in advance of the teclmlcal capability of 
tUe assessiqent community. Several developmental efforts, however, by the 
American College Testing Program and the Educational Testing Service look 
promising. 

Fiv orolsln p; Fludluss 

- Coupled with some difficult and sometimes pf^luful lessons learned 
during the past year have been some promising and encouraging findings. 

4 . 
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. „ ill FacuHies across Touue^r.ce are v.m y < on. or nod 

, f.m.anc^ They «euse that funding solely in term., 
about Instructional porformanc^, mey , 

n...tlr^» of academic Btandards. 
of •nu.hev of stuUeut s served cncoar.,e. prostitution 

AddresMng th<.,<iuestlou of v^^at coi.Btit..tcs 

... .oca. .o.„. o. a s.a.e„Ue To.^. ..onso..a .he Ko.a ro„naaUo„. 



ought to piwssess- , • " 

V ^A<T^a Prolect is causing 
J 4 „ Tl*/» Performance Funding VTO^f^i^^ 

Wa.eae „rfac.a., .e„^e„ anU aa..:i;»a.o.. to taU. a se.iou. loo. at • 
the effect they are having on Btuaents. 

,„e.t":n. tW VaS.ea the ..o.ect .nU.a. .ta.ea. .or .nuance, 

can vo. have e,uaX rlso. .n th. a.ee„.ent o. ach„t o.^.oaU 

\ i^rAtors differ from campus tp campus? One 
When gbals and performance indicators 

Id be to have a board of visitors provide au assessment of ^ 
• possibility would be to nave _ _ , 

n^n«t its set of individually developed 
each institution> perforraance against its set^ _ 

. ' ^is This assessment could, in turn, be translated into 
instructional go^ls. Ihis ast, 

. .actor to he n.ea . aX.ocat.a. so, portion o. the state — ; 

,,,,^i^.^S. -mtlal l.p.esslons su^seste. that a cla»sl«catlo„ 
..che.e or ,oaeX fra,e«orU o. luUlcator aeveIo...nt .X«ht e.er«e ..o» the 
;or. oe ..not projects. Xt .as ho.a t..t the maXcators aeveXo.ea h. eXeven 



ncaay fall iuco . .asea o. type.' ^ 

_..no..o.e.....^ ^^^^^^^^^^^ 

instlcutlona and pro,ra«.s, typ ^ ^^^^^^^^ 

; Pilot project results do not app.^a 
stitutlonal goals. Fllot p 3 . ,,,, Tor example, indicators 

of discreet classitlcatipn. Tor 
themselves to any sqrt . ^ ^^^^ ^^^3^1^ 

,.nt achievement at two community 
— - ---^ ^......ities than the indlcat.r« 

.esemhle those developed hy two regl 

of the third community college. ^.aerscores a very -pleasi.. 

this finding only under o 
upon reflection, however. .^ersities can egress 

x^^r^ /olleRes and universiv-^ 
f this proJect-^-that public colleg 
outcome of this pioj 

aci A research elioru 
X„ conclusion, a. a , ear to .e ve.y 1.- , • 

e«.lon pe.for.ance measures, our P 3 ^^^^ ^^^^^ „ . 

f „11 the iudlcators developed or ide _ 

,„sBlve. Outj^l^*^_ , „„ rtose offered In a 1974 NCHE«S 

„,v a small number differ from those 
,.o,ect.. cnl, B ^^^^^ ^ 

0„s Measures Xdentl ^ that faculty are vlUlns - 

— Je^cpresslons of ^ . 

\. Identify and develop PuhU ^ ^^^^ , 

... reflect the uniqueness o^ . ^^^^^^^^ tha. .Ul 

the performance Jundlng Project is to mp ^ 



pro»o« that activity. 



T c* ti.^ttoR The Condition of Kducation 
^National Center for Kducatlon StatlsLlcs. .nH_ coi_c 

(Washington: CPO, 1975). 

F^c«t.l_ou (Bould.T. Colorado: NCHEMS. 197/). 

^ 1 rkf Fauratlonal Indicators/' 

\eu.is D. cooler, V'Trrr^rthrstaro o Ftc:Uon (PrinCton, N.J. 

m 5dK.catlojial_ldldi5llP-I^-- - M?_»_li?Xl-ilS^ theJitaH- 

ETS. 1973). 

» TU^ iilohpr Education Outcome 

^Sidney S. MIcck and WUUam R. Arn^y ^^Ifi^'-^fj^.^^!^ 19747: :s 

ne^.^SOJuJs!l^^S^SB^AS^ Colorado. NCIIIMS, ig/'.; . 
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PERFORMAffCE INDICATORS 
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SORVEY'OF PERFORMANCE FUSING PROJECT 

AT 

COLUMBIA STATE COMMUNITY COtLEGE 



PRESIDENT OF THE COLLEGE; Dr, Harold S. Pryor 
DIRECTOR OF THE PROJECT: Dr, William A. Tallon^ 
DESCRIPTION OF THE COLLEGE: • - 



coVeoV'^'jll llTJ^u^'Ci}^^^^^^ ^" 1966. ms Tennessee's. first conmunlty 

south of nIsLi? i ^ ri! Inii JJ^ CO umt4a. Tennessee, a city of 30.000. about^rty miles • 
south ot Nashville, The college enrpl Is approximately 2.000 full-time equlvaleHtstudents. 

'. • .. ■ ■* . ' 

Columbia State offers two areas of Un1vi?rs1ty paralleT courses In a w#'e vSrietv nf arnA<: 
to prepare students for Work on.the senior ^college fevel. ir^l.^of^e^s a Lmber program 

S"n!"?^'' and preprofess1onai.work for those students preparing to enJ^lndSstr^^^Sneis 

??n,Hnn T ^M^''"^ ^" ^^'^^ y# perlod. The bollege also offers a program x,f con -fi 

tinulng education for either cre41t or nortcredlt. . « " P'uyiamwi cun y . 
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INSTITUTIONAL GOAlS AND PERFORMANCE INDICATORS 



GOALS 



ASSOCIATED indicators" 



(1) To prepare students ifor advanced 
academic work at a four ye^r or 
'professional school. 



(2) To prepare students for specific 
occupational careers in two year^ 
of academic work. 



Wrcent of qy^ilified students who transfer as 
' measured by institutional records. • . ^^ . 

- Percent of transfer ^tud^ts re(;eiving degicee. as 
measured by receiving school's records. 

' Student GPA-at Cdlumb'ia"' State and at receiving^ . 
institution from institutional retords. 

Student responses to survey questions.. ^ • 

Number of credit course offerings that are- 
college parallel. (3) 

Length of time for Career Education majors to 
receive a degree. # 

Number of graduates passing licensing ^xam on the 
first try. as ^reported by licensing agencies. 

Graduates responses to survey (Questions concerning 
satisfaction with preparation/ time till first 
1 job. whether working in. their field, and >§ftlary 
earned. 

Employer responses to survey. _ 

Number of majors offered.. 
Number of majors certified. 
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GOALS 



ASSOCIATED INDICATORS 



(3) To provide opportunities for continuing 
education In the service area. 




Number of evening and off-campus courses offered. 

Number of workshops ami seminars sponsored by CSCC. 

y * . . - 

Number of requests from local businesses for speclaV 
C(Jurses or workshops. • • 



Number of continuing educa|:ion units granted each 
year. 

* Student satisfaction with courses or workshopSi as 
measured by surveys. 



(4) To provide remedial Instruction for 
students who are not academically 
preparefi for college level courses. 



. 

Student success in credit courses related to the. 
deveTo|)mental course. ^ 

Student satisfaction with developmental courses. 

' Student test score gains after taking a developmental 
course. 

Final GPA of those who take developmental courses • 
compared to those who do not. 



(5) To assist students in acquiring 
basic learning and study skills. 



Number of students Increasing standard test scores 
after completing the program. 

Number of students remalaing In school after com- 
pleting the program. 

GPA of students in the program compared to those 
not in the program. 

Student satisfaction and increase In self-confidence 
after completing the program. 
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GOALS 



\ 



*(6) T4> provide acadetnic and vocational 
4 counseling for students. 



\ 



ASSQCIATfeP INbJCATORS 



NUrnbeV of students advised to take developmental 
< courses and the number who do, • 

Number of students advised to take study skills 
program and the number who do. 

'Number of students developing realistic career 
and educational goals while at Colt^mbia State. 

Student satisfaction with advlsiilg program. 



(7) To 'increase the depth and breadth 
of knowledge for those students 
receiving an Associates Degree. 



Scores of graduates on National Assessment of 
Educational Progress test materials, \ 

Scores of graduates on ACT test compared to their 
entering scores. 

Scores of graduates on local math test^ writing 
sample and Nelson-Denny reading test compared to 
their entering scores. ^. 



(Q) To offer a wide i^ange of special 
activities IntendRl' to Increase the 
general cultural level of the 
service area. . ^ 



Number and type of programs sponsored by Columbia 
State for the community. 

Attendance at special programs. 

Number of faculty giving talks off campus, 

'Number of groups using Columbia State facilities. 



^ -. SUMMARY OF PERFORMA>lCfi FUNDING PROJECT 

AT • * * 

/ 

* THE UNIVERSITY 01** T2NNESSEE, KNOXVILLE 

CHANCELLOR OF THE UNIVERSITY i Dr. Jack E. Roese \ 

DIRECTOR OF THE PROJECl's ^ Dr^. Frad N. Peebles 

DESCRIPTION OF THE UNIVERSITY; ' . 

*^ » 

The University of 'i'onnessQO, Knoxvillo is the "capstone" campus of Tlio University 
of I'enncssco, a multi-campus, multi-purpose system of higher education encompassing 
all Tonnoosco. Tho University of Tennossoo is both the State University and the 
official Land-Grant Institution of Tonnoosee. UTK socks to develop human and material 
resources of Tennessee through public service. In the fall of 1976 a total of 29,711 
students were enrolled at The University of Tennessee, Knoxville. To serve the academic 
needs of these students, irfK offers HI degree programs at the bachelor 'level, 123 
at the master^s level, and 52 at tho doctoral level. ' , 
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Tho UTK Performance Funding Project is being carried out in tho UTK.Collogo of , 
Engineering and is intended to bo a pilot effort for the Knoxville Campus. Upon 
cou«>ietion of the college-level study the methodology and approach to assessment ^ 
of engineering education effectiveness will be utilized in the asseasmont of 
offoctivoness in othor profeasional dicclplinaa' of UTK. 

The UTK college of Engineering Performance Funding- Project will assess the effectiveness 
of engineering education offered in the college through measurements of three performance 
variables I f 

(1) engineering graduates' knowledge of the matheroaticS, baaic sciences, and engineering 
8cienceo# • * 

■ 19 
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and # ' * 

r ii«o^ EnqinoorTng Decade Goals-An Emphasis on 

be hoasurcd through perfor-uanco ""f """^^^^iroxaminatlon for 200 to 300 "-'nio" 
Tramlnc, (E.I.T.) -^■"^"fi"". ^^S^nal no™:, and en^lneerln., educatidV> ««.otivenc.8 
por vaar will be coiaparod with .national no , ^ jho national norma. 

rilAe indicated -^^d ^ilLrn^ ^araS UXK en,in«eiin. ,rad,.te. 

ru^rdro thr:u:r«apon^oa to a new .urvey [uostionnairo 

v.^«/i iiTK baccalauroato dogreos during 
,a) self-analysirf of 500 to 1000 graduates awarded UTK 

the past ten years * - 

h. .u^rviaors of the sa^ SOO to 1000 graduates who provide the self analysis 

' responses # and ' ^ 

. ..no faculty £or tl>e 600 %o 800 graduates awarded B. S. dogreoa 
tiA bv UTK engineering tacuicy v. 

during 1976-77 and 1977-70. ^ 

. ^ rnlleoo of Engineering Decado Goals 
«.,«.s«ent of .progress toward achievement of J, ^oard of Visitors 

:t^^rrsi:r:nr:Snra:rrdr^^^^^^^ — 

practice. ^ ^ 

rd^caLrt^rtLtop^itti^^^^^^^^^^^ 

Performance Funding Project, 
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KXillDlT A 

rXPKCTED PHOFKSSTONAL CHAiaCTF.RTSTlCS OF 
UTK KNGINtl^UNG Gimt)UATi:5 



FactuAl KuowlodqQy a strong background in nathematlcn and an 
understanding in some depth of one ot moro axeas of applied science; 



o At>ility to Define jtnd Solve ProhJ cms |. am oiTder^ly jvet of thought 

processes for identifying and solving unfaniliar problonXs, includiny 
tho ability to deci!de upon the infonnation nooded to solve a giveit'^ 
problem, the ability to obtain that information Jfrom available 
ijourceSr and tlie ability t.o define feasible methods for developing 
Vc^s, inforniatioA if otherwise unavaij.able; 

/ 

^ fibiiity t o An alyze Sy stems r P roces ses ^ Machine's y or Pe viceSy commonly 
utilize<jL^in the graduate's field of engineering practice; 

o Ability to Apply F undamental Elements of the Des icjn Process , 
(e^tabrishment of objectives and criteria, synthesis, analysis, 
' construction, testing, and evaluation) in devising a system, 
cromponent, or process to meet desired needs; 



Ability to Communtcatp, the lability to comm»jmicate clearly with other^s 
orally and in writing; 



o 



Moti vation to Continue Professional Develop men t as a Life-long P rocess , 
through independent study, organized continuing education prograxns, 
or part-^time ^study toward an advanced degree; 



Professional and Social Responsibility, an appreciation of t;he 
interaction bet-ween technology and society as a whole, and a sense 
of responsibility for Assuring that this interaction is harmonious; 
and * - i 

KnCTtfledge of and Ability to Apply the Code of Ethics of Engineers 

in/Professional Practice. 

^ — — ^ — — ■ — ^ — ' — — 
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KXMIBIT 6 

COLLKGK OF ENGINEERTNG GOALS FOR TKE NOT DECADE: AN M^BftlASlS ON FJCCELLEWCE . 

1. Achieve national recognition for excellence of all engineering progriuns.. / 
llif* mrksurcH of Ihlo achievement Include: the devt^lopment of h 'superior 
climate of Icaraiug approprlatj-e for a profeuriional tichuo-l.of engineering; 
the development of a faculty end student body^ of the highest *calJLber 
consistent* vlth meeting the educational requirements* of the ;state; the 
achievement of a uniformli^ high morale among the faculty and students; 

o^d nationally reco^ixeol engineering accomplishments of a quality vhlch 

is professionally and intellectually satisfying to both faculty and students. 

2. Develop ai\d maintain teaching excellence as indicated by tbs learning 
accomplishments of students and by such faculty characteristics as being 
well--prepared for all classes, being genuinely concerned for »and able 

to communicate vith the students, being available eind villing to assist 
]^tudents outside of class, giving well thought out and fair examinations, 
and seeKing and encouraging criticism from colleagues* 

3* Continue to up-date and up-grade the undergraduate progi'ams-so that the 
grj^duates are prepeured to begin px^ofessional careers in engineering* 
Indications of how relevant the programs a^e to the needs of the 
. professloa include: the number of students enrolled; the ability of 
f:raduates to obtain professional employment; the extent to which employers 
seek, graduates ; the interest in professional societies shown by the students 
end the graduates and their qualifications to become registered engineers, 

U» Achieve and xaaintain full accreditation by FCiPD of all engineering jcurricxila. 
This goal includes acc^redltation of the graduate prog:rams under EfJPD's new 
d^^slgnatipn ©f advanced professional programs • . 

5* Expandi^1:ie engineering design and development,- research, and public service 

programs for outside agencies 42fto involve mox^e faculty membex^s and participatioi 
of 5~lO students per faculty member; with expenditures of about $^,000,000 
• annually, of which moi'e than $800,000 are. provided by private industry and . 
$1|00,000 from pther non-federal sources. 

6* Increase/ the full-time graduate student enrollment in every degree-granting 
dep^tment so that there are at least 3-5 full-time graduate students per 
f\ill--time faculty member/. ^ \ 

* * » 

7. Focpand and improve relations with Tennessee industry, the vax^ious departments 
of state government^ and the mimicipalities of Tennessee so that . faculty, are 
deeply involved in the solution of technical^ probleia^; of Tennessee *s industry 
and Tennessee *s governmental agencies. Continuing efforts on small-industries 
research, engineering extension services for all Tennessee industries, and 
cooperative projects with the various city governments of Tennessee and* the 
operating departments of Tennessee government vould indicate that this goal 
has been achievck, ' . • • 

8. Initiate in bach department significant cooperative px'<^3ects with industrial . 
^ associations which build on the specialized interests and talents of the 

faculty. These projects should serve to build up *'peaks of excellence" in 
the departments and should afford imusually attractive opportunities for 
education of engineering students. There should exist at least one such 
cooperative project for each curriculum area of sp^ci^tlization offered in 
the various departments. The Industrial Consortium for Polymer Research 
and Eduaation sei^ves as' an example of the cooperative projects with industrial 
associations to be developed. 



SUMMARY OF PERFORMANCE FUNDING PROJECT ' 

AT ■ ^ 

THE UNIVERSITY OF TENNESSEE AT MARTIN 

CHANCELLOR OF UTM: Or. Larry T. McGehee ^ ' . . 

DIRECTOR OF'^TilE PROJECT: . Dr. Joseph L. DeVitIs 
DESCRIPTION THE UNIVERSITY: 

ThP iinl«pr^1tv of .Tennessee at Martin Is a state-supported university of approximately 5.000 
studenU." Ihf tool lI'™tuated1n"Northwest Tennessee, about 125 miles "orf-heast of He»ph s and 
150 mllos northwest of Nashville.' The,Un1vers1ty traces Its orig ns back to 1900 but did not 
JecolSi f sen W college until 1951. In 1%7.. the institution officially became The University of . 
Tennessee at Martin. 

The Univprsltv of Tennessee at Martlit Is a primary campus of the University of Tennessee 
...tl In broad referenc^ n role and function are similar to those of the University, inc uding 
fst :;t1 .Tub?irsTrXe: Ind res:arch. But in emphasis and focus. ^^^^SiatrSaUo^ ' 
an instructional unit with significant responsibility and concern for undergraduate education. 

{hesXe offer^'through the schools of Agriculture. Business Administration. Education. Engineering 
and Engineering Technology, Home Economics, and Liberal Arts. 
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. INSTITUTIONAL GOALS AND PERFORMANCE INDICATORS 

« o ■ ■ ■ 



GOALS 



"nrnro^evelop basTTsFnTTompetencles in 
English compo5ltion, reaaing, and ^ 
general mathematics. ^ . 



(2) To encourage students to evaluafe" 

their personal/social values and goals, 



(3) To develop main-depth competenfce In a 
discipline. . 



ASSOg^iDjlMCA^^ ..... 

TlT^SimTETor^ of StandarO^^ English lETbJ 
Reading - Nelson-Denny Examination 
General Mathematics' - UTMsMathematics J>lacement 

Exaj^i nation 



(2) Rokeach Value Survey 



(3)' Departmental Examinations 



i 



SUMMARY OF PERFORMANCE FUNDING PROJECT 

AT 



DESCRIPTION OF THE UNIVERSITY: 



Th€^ University of Tennessee at Nashville is a state supported university of approximately 4.700 hfiadcount 
students in the college credit programs. Located in the capitol city of Nashville, population of approximately 
486.000. the Institution, which is now UTN. was established in 1947 as an extension center of the University's 
Knoxville Campus, offering evening classes for' working adults. In or^er to meet community needs for a fully 
functional. evening university, the Nashville Center was granted permission to develop into a four-year degree- 
granting institution upon completion of accreditation requirements of the Southern Association of Colleges ahd 
Schools. Accreditation was gralrted in January 1971 when the Institutional self-study, begun in 1969, was 
approved by the Association. In 1971, legislation was passed by the Tennessee General Assembly creating a new 
UT campMs, The University of Tennessee at Nashville. 

The University is located in downtown Nashvi}le and has no dormitory nor athletic facilities. Approximately 
70 percent of the students are employed 40 hours -or more a week and the average student age is 27. A majority 
.of the students (approximately 00 percent)^ live within 15 miles of the University and approximately 70 percent 
of the studeots have^previously attended another college. At least 90 percent^ the student population is» 
enrolled for dndergraduate work. 



UTN's facilities are used, during the daytime for a wide variety of public service and continuing education 
activities. Some 50,000 persons annually attend conferences, workshops, seminars, and government training 
classes at UTN. " ' . - 
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THE UNIVERSITY OF TENNESSEE AT NASHVILLE 

' ' ' 

CHANCELLOR OF THE UNIVERSITY: Dr, Charles E. Smith 

DIRECTOR OF THE PROJECT: Doris fi. Sullivan ' ' 



If.-. 



UTN offers associate degree programs in nursing, fire science, and office administration. Baccalaureate 
degrees are offered in arts and sciences, business administrationN.^ education, engineering, and nursing. The 
campus has onev,graduate program, leadirfg to the Master of Business Administration degree. Resident credit 
courses lead to the master's degree in engineering and in public administration. All degrees, except the 
dssoci^e degree program in nursing, are offered in the evening. In addition, UTN, in cooperation with^the 
Tennes&e Department of Corrections, offers through its "College Within the Walls" program, courses leading ' ; ; 
to the Associate of Arts decree for inmat^ at three state penal institutions. ^ . ' 
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' II^TRUCTJONAL-GOAL STATEMENTS AND ASSOCIATED PERKORMANCE INDICATORS FOR UTN 
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"^l^trate an i 



^^^rate an in+depth knowledge In their chosen area of 




^ INSTITUTIONAL GOAL STATFMFNTS FOR STiinrwTc: uiin mtm ocrciMc 
^ • * • vr < A v/i«oi^ yjyjfM^ o I r\ 1 Li iL.li 1 s> rU(\ oiuUL.l\l<i> WmU WILL KtLcIVh 

A BACCALAUREATE OR AN ASSOCIATE DEGREE FROM UTN 


. ASSOCIATED PERFORMANCE INDICATOR 


• ^ L/t.iiiv«ii;>(.i a a Hiabtery oi tne ski lis or coniniunlcatlon * 
reading, writing, and arithmetic. 


= ■ - ■ ■ . —Llfc-^ _ . - 

. ^ ^-..^^ . ^. . , ^ ^ , 

ACT College Outcome Measures Project 


2. Express a sense of self-worth and self-confidence. 


Sixteen Personality Factor Questionnaire 


3. -Demonstrate ability to acquire knowledge. and to apply it. 

s 

. ■' " • — ^ . .. 


ACT Col llege^ Outcome Measures Project 


4. Demonstrate analytical and problem-solving skills. 

— — ' — ' — » -1 — ■ — . , . 


ACT College Outcome Measures Project 


•^v.M<uii3 1.1 u |.c an awar t.iit:^:> or tjieir own vfllues and the values' 
of ot[>ers. 1 


ACT College Outcome Measures Project 


^ 6. Express the ability to cooperate and work with others. 


Sixteen Personality Factor Questionnaire 


7. Demonstrate a basic background in the humanities. 

■ -- — — - — 


ETS Undergraduate Program Area Tests 


a. Demonstrate a basic backgryound in the social sciences. 


~ ■ — — — ^ • '- -- t . 

ETS undergraduate Program Area Tests- 


9. Demonstrate a basic background in the natural sciences. 


ETS Undergraduate Program. Area Tesi. 


issues » and problems. . ^ ^ * 

r " ■ — ■ — X ... 


ETS Uhderg-raduate Program Area Tests 


11. See their college experience as satisfactory. 

— — ■ ' — , — ^ — » — — . . 


Questionnaire and follow-up study 


^- Express a desire for or commitment to life-long learning. 


Questionnaire and I'ol low-up study 



/ 
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ETS Undergraduate Field Tests and Students' Perform- 
ance on Professional and Graduate Admissions ^xam$ 



NON-DEGREE SEEKING STlioENT POPULATION 


INSTITUTIONAL GOAL STATEMENTS FOR NON- 
DEGREE SEEKING STUDENT POPULATION 


ASSOCIATED PERFORMANCE INDICATOR 


1. Careor-orientcd--Improve skills for 
promotion and/or raise in salary 
in the. field in which the student 
is currently employed. 


Aid the student in improving his/her 
skills so that he/she may be at)le to be 
promoted and/or receive an increase in 
salary in the field in which the student 
is currently employed. 


Follow-up questionnaire In which 
student is asked whether courses 
taken at UTN were beneficial in 
obtaining a raisJ^ or a promotion. 


2. Career-oriented--pevelop new skills 
in ordeV to obtdi<n a position in a 
different field than the one in 
which the student. is currently 
emol oved . 


Aid the student in developing his/her 
skills so that he/she may be able to ob- 
tain a job in a different field than the 
one in which the student is currently 
employed. 


Follow-up questioiitiai re in which 
student is asked whether courses 
taken at UTN were beneficial in 
obtaining a position in another- 
field. 


J, oai cer-or icnLeu — utvi-iuij new 


Provide counseling to aid the student in 
choosing} a career. 


Percent of students obtaining 
career counseling. 


in jorder to enter job market. 


Aid the student in developing skills 
which will enable the student to success- 
fully enter the job market. ^ 


Follow-up questionnaire. 


4. Broadening of knowledge and cu)tural 
^ enrichment. 


1 ■ • — — — . — — — 

Provide courses which students may take 
for cultural enrichment and an increase 
in knowledge about the subject. 


Follow-up questionnaire 

• 

* 


_ — _ ^ • 

5. Social reasons. 


Provide an atmosphere in which adult 
students may meet and discuss colhmon 
areas of interest". 


Questionnaire 


6. Unsure as to degree area. and are 
simply taking some courses which 
they, hope will help them make a 
decision. 

\ 

\ 


Provicje students with the opportunity 
to "try out" different at'eas when they 
are unsure as to^their degree choice. 

— . — J— 


Questionnaire 

* 

» * 
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NON-DEGREE SEEKING STUDENT POPULATION 

\' 


INSTITUTIONAL GOAL STATEMENTS FOR NON- 
DEGREE SEEKING STUDENT POPULATION 


ASSOCIATED PERFORMANCE INDICATOR 


7. Preparation for professional exami- 
nations. 


Provide courses which will increase a 
student's knowledcie.of a particular sub- 
ject and at the same time Increase his/ 
her ability to pass a professional . 
examination. 


Entry and exit examinations. 
Follow-up study. 


8. Prerequisites for MBA 

1 


Provide courses which will increase a 
student's knowledge of a particular sub- 
ject and at the same time increase his/ 
her ability to be successful in the 
MBA proqram. 


Entry and exit examinations. 
Follow-up study. 


9. Transient students- 


To provide courses at a time or place 
which is more convenient for them Or 
less expensi ve/than the cost of the 
course offered by the institution from 
which they Intend l-: qraduate. 


-1 . 

OLestionnalre. 

) 
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GENERAL INSTITUTIONAL GOALS 



To provide an educational opportunity for the adult who 
works during the daytime hours in the Middle Tennessee ' 

To Wovide art educational opportunity throuqh the external 
degree program for the adult who has a difficuU time 
attending cUsses on a campus on a regular basis. 



To provide credit for life experiences which are applicable 
toward a degree through the use of CLEP and proficiency 
examinations ^ '^-icuuy 



To provide noncredit activities which will Increase the 
chance of success of the student who finds that he/she 
■^^M J-^.^n""^ developmental work in order to be able to do 
progrim ^" undergraduate degree-granting 



To provide an educational opportunity to the inmates In 
three penal instUutions in the state. 



♦ » 

To develop and sponsor or cospon^ior with -experts in the- 
communUy, institutes, conferences, seminars, workshops, 
and symposiums which will be of benefit to the adult 
population in Tennessee. -- 

• 



— \— ^ 

To create an Insw'tution recognized for, its public service 
coimiltment to the comnunlfy. i'"""c service 



ASSOCIATED PERF0Rf4ANCE INDICATOR 



Percent of students who ar/e working adults. 

Percent of students working toward external deqree who 
could not have attended classes on a regular basis. 

n „ .. . * - 



Nuiliber of students taking CLEP and proficiency exami- 
nations per year. ^ 

I 

^^.A.r., 

~ ~ ZL 

Number Of students enrolled in developmental courses 
Entry and exit examinations. ^uf:>eb. 



Number of students enrolled in the Associate of Arts 
degree progra,m. , ' 

N . . • 

Number of institutbs. conferences, seminars, workshops 
and symposiums offered during a year yrN^nups. 
Summary of evaluations administered at the end of all 
nn^i.mf fn' f^"[^^f""^> seminars, workshops and sym- 
posiums in which the. participants have an opportunity 
to state .the benefit of the program(s). 
Follpw-up questiopniire to the employers of the 
participants when applicable. .. 



— I 

R«ndofl*4afnpI1ng of the community, to determine 'its level 
of awareness of UTN's public service activities. 



GENERAL INSTITUTIONAL GOALS 

r 


ASSOCIATED PERFORMANCE INDICATOR 


a. To Include local citizens in the short- and long-ramje 
planning of the institution's public service activities. 

4 


Statements from the Dean of Public Service and the local 
citizens involved as to how and to what extent they 
were in\rolved in the planning of UlN's public service 
activities. „ , .. 


9. ' To work with the center for Government Training in offering 
cour'ses of study which wiU increase the efficiency and 
productivity of government employees. 


Follow-up study of povernment emplo^tees who have attended 
classes at UTN and their supervisors^ 


10. To provide continuing education units for courses of study 
which qualify for the unfts and for which there is a demand 
in the community. - 


Number of continuinq education units awarded during 
the year. 


■ _ — — ■■ ■ — 

11. To provide an atmosphere which will encourage adults who 
have had an unsuccessful academic college experience in a 
typical college setting to attend UTN and to aid them in 
being academically successful. 


Ouestionnajre 

Report on transfer students* cumulative grade point 
average before and after attending UTN. 
Retention study. 


12, To offer review programs for professional examinations 
which will be of benefit to the participants. 


Number and type of review programs offered. 
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Report of the Task Force on Improving t»Kr Operation of Frdrrjiliy 
Insured or Financt<l Housing Operations, Volumes \, II and 
* III, National Center for Housing Management, WasfMngton- 
Octoberl9/2. 

Housing In the Seventies: Chapter 4, Department of ^^ousing and 
Urban Development, National Housing Policy Review, 
Washington: 1976. 

HOW Housing Allowanced Work, Integrated Funding from the 
Experimental Housiivg Allowance Progranv the Urban Insti- 
tute, Washington, D C.: Febnjary 1978. 

lower Income Housing Assistance Program (Section 8),\)epart- 
ment of Housing and Urban Development, Offi<;e of l^olicy 
Development and Research, Novetnber 1978. 



Sev:tion 236 Rented Housing-^ Fvaiuatton with Lessons for tin* 
t^utu^r, Cernrral Accounting Office. PAD 78- 1 3, Washington. 
1978. 

Commuoily Development 

Vhe Model Otles Progran^ Department of Housing and Urtwin 
Development, Office of Community Development and Eval- 
uation, Washington (AUD-CDED-MC-37). No date. 

Block Cranb for Community Developftient, Department of Hous< 
ing-and Urban Development, 1977. 

Decentrali:eing Community DevelopmentyOep<irtmentof Housing 
and Urbafn Developn>ent, 1978. 

Community [;>evelopment Block Grant Evaluation Design, Univer- 
. sity of Pennsylvania, 1 979 (unpublished document). 



Evaluation in Higher Education: Departmental and 
Program Review • 

Vmy A. Braskamp 
Measurement and Research Division 
University of iillnois at Urbana-Champaign 
Urbana, Illinois 61 801 

Program evaluation In higher erJucation is an inclusive term which 
includes several tyges or forms, institutional njsearch, reputational 
rati ngsv Voluntary accreaitatidh,'depaftmental and intrainstitutional 
program evaUiationc^^and review, evaluation of currlcular de$ign> 
and state-level program reviews. These six' types of evaluation 
encompass the vast range of purp05<^s of evaluation, the intended 
uses and audiences of.the evaluative information, types of inform- 
ation collected, ^nd methodologies used In collecting the data. In 
this article, departrVtental and program reviews and evaluations 
within an institution will be highlighted. Itisthetnost recent.syst^nv 
catie form of evaluation (perhaps the most akin to the common 
definition of evaluation) and represents a fairly recent response by 
those m higher education to four^nterrelated pressures: the need for 
^^kr' sound Institutional rnanagement;lfienc6ntlnual^siro for self im- 
provement; the need to assess quality* anc^ the obligation to res- 
pond to deniands by those external to the university for accountabi- 
lity. ' ^ . 
The lj5t ten years have seen a considerable Increase in program or 
.depai^nent reviews. In a suA/ey of 1 34 colleges and universities 
with gfa^ilite programs, CJdrkJ j.^//) n^s that over one third have 
$ome4^^ of systemitic departmental review, there arc several 
leasons why program reviews have become popular. The highly 
quantitative managerial and fiscal data provided by centralize^ 
offices of institutional research have not been sufficient to satisfy the 
ni^s of campus administrators and faculty for Infonnation about 
quality. Moreover, local campus officials could see iftat ^UicjEjlld 
not i^^lgixsome nKinitoring and quality control processes, itate 
a^ncies arid legislative staffs would institute, ain accountaiiility 
system. Thu^ departmental program evatuations.were intended for 
Internal use, with the faculty and campus administrators sen/iggas 
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the primary audiences. Although accountability was local, the 
institutions used this process to denrK)nstrate therr responsibility to 
tfie external constituencies. 

The m<^tj;pfnfTionj^ purpose o/ the departmental review is 
to serve administrators in conjunction with the faculty in making 
institutional wide budgetary decisions and planning. However, 
thete has been also a strong undercurrent to use the evaluation as a 
vehicle for S^'limpif^^^ (the summative-fonnatlve distinction). 
In praalce, reviews ^i^re used fbt both tunaions. In the early stages of 
a program review, tlie faculty are especially attentive to the first 
purpose; i.e., how will an evaluation be used by tfie central admin- 
istration? The governance process in most educational Institutions 
has been (an^l still is) one of accommodation, compromise, and 
ryegotiation, rather than of authoritf figures ej^ising financial aini 
managerial power. While there has been a trend toward a central- 
ization of planning and information processing, facilitated by the 
emergence of computerlied and centralized data bases, the deci- 
sion making at an institution still is predominantly diffuse, decen- 
tralized, and vested within the academic community. This Jensiotf 
betVveecicemr^iMliQO and decentralization surfaces when a new 
administrative process is Introduced, since infomr^tion from an 
evaluation is viewed as i sflUrce of power in the policy making 
process. 

Most program reviews do not follow closely some model or 
. cprtlfltoptualization of evaluation. Coal based evaluations aie more 
apt to be found in colleges where competency based in^tnjctional 
programs In vocational and technital education are mor^ common. 
^In general, rm^ reyiews rely heavily on professional judgmen|:s. 
Values andcriteffa for judging worth are implicit. '70 trust diligent 
observatidn and considered judgment/' a key idea in Stake's res- 
ponsive e>^fuation approach, Js often an implicit characteristic of 
departmental evaluations, pften the process begins with a depart- 
mental or unit, self-study In which the faculty get an opportunity to 
present their caseTTonslderable .descriptive data (e.g., faculty 
demograpHic'data like research procJuctivity, service assignments, 
' /leaching loads, student characteristics, fiscal information, and stu- 
^dent credit hours pro^luced) are collected or obtained from central 
" information systerrji^plscussions by the fa.culiy about departmental 




goaU, K<iii^, n)n< erm, and ^It a5M»^MTicrmo< quality an^Alno .5 key 
part otSthevKjlf 5tu<iy. A twrcond p^i^^e may Involve ^ gfXDup 
pi^of<nsti)iuU mi., faculty' n>cmben> in similar disciplines from 
other univer4ifies. faculty M the wmc Institution, or rx^presontattvm 
from citizen groups, professional associations, and Uatc legisla- 
tures) conductive Intensive Qo-slte vi^it^ to interview dc*panrTH?ntal 
faculty and local administrators, Qn some campuses an appointed 
task force has been used to conduct an indeplh study to replace the 
s<*lf evaluation. Kit the time demands have been too great to make 
this approach widely used. A CQnualu^Kl COrrimlttce. consislmg of 
appointed and/or elected faculty members arnl S4?lected adminis- 
trators often is involved throiighout the evaluation. It may monitor . 
the entire process, provide assistance in data coHeOion, and spend 
considerable time in discussions about the relative mcnls and prob- 
lem areas of (he units. The evaluations are often not explicitly 
comparative; i.e., the uniquem?ss of each departmerit is espoused 
and information about similar departments at other universities is 
often too costly to collect However, if tfie major impetus for 
initiating evaluation is for reallocation purpose!^, the final judg- 
ments ai^ of necessity comparative. The committee is usually ad- 
visory to a vice chancellor or president of the institution and makes 
reports to two primary audiences— the departmental faculty and 
the central administration. 

One of the majpr^ftg^nce^^ been the confidentiality and 
public access to raw data, self evafuations, [u^^ents of designated 
peers and administrators, and the openness of commihee meetings, 
lliere has been the inevitable tension between the right to know 
and the prX3tection of the privacy and confidentiality of those evalu- 
ating as well as those being evaluated. Faculty as much as any one 
value their privacy ami autonomy. Few In higher education can 
clearly separate program and personnel ejfeluatlon. 

What is the future'of formal departpiental and program review 
processes? They~sfiould coritinue'to be useful. This approach incor- 
porates value judgments by faculty, input that reflects the quality of 
an institution. By and large, universities and colleges are self cor- 
recting institutions: ihey cannot completely succumb to all en- 
vironmental and external pr^sure if they will serve American 
society as they have in the ^Mst (See George and Braski^mp. 1 977)/ 
This approach has been highly interactive and has facilitated twc^ 
way open communication networks between faculty and admini- 
strators and in some casts with slate government officials. Based on 
research on knowledge and information utill/atton. Interpersonal 
contacts and relaDpnships ^ire important for establishing trust bet- 
ween the parties and an appreciatiori of each other's position- This 
arrangement may be one of the most effective ways to demonstrate 
accountjabtllty and to establish the crediblHiy of the i evaluation 
efforts, Given the tradition of faculty involvement In tTie governance ^ ^ 
of an institution and the high likelihood f<^ Internal realRxatlons in 
the next dt!c*ide. a process that Involves extensive pa>/icipation In 
data gathering, data interpreMtion, and data dissemkttition seems to ^ 
be a* go<Ki an alterrutive afi anyy' ^ 
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The challenges for those in higher education evaluation will 
center on three issues. TheJficiO^* develop ways to systematically 
collect better judgment and quality data. The considerable daU 
collected to date have been primarily dt>stiipnve, quantitative, and 
focused on input measures. We have little Infonnatlon on how an 
Institution Is doing as a place to learn, explore, and develop peopfeJ 
^gtondly, the academic community will need to find ways to op<?n 
wp the (liscussion.of solutions which will adversely affecl some of 
the faculty. T\^e sensitivity to zero sum budgeting and retrenchrnem 

^ are important At institutions which aspire to be high quality it?- 
search institutions, there exists an Inherent conrllct between quality 
as viewed by the university academic comnujnity and quality as 

, viewed by the practitioners in tin? field and the general public. It 
Devolves arounfd the priority given to the faculty research produc- 
tivily and the praaical missiop of the department. This Is most acute 
In the professional schools such as education, library, social work, 
and mtxJicine (see Atkin, 1 978). But as fewer and fewer graduatc»s of 
advanced programs will be in similar positions like their meniorv 
tills tension about ily^ mission of the school becomes a pivotal point 
in assessing quality. , ' 

The final challenge Is to more adequately integrate evaluative 
judgmental data and bud^jtary fiscal data. While benefit analy>*^ 
practiced In business viTill not likely be vtny useful In higher educa- 
tion (Millett, 1975). an InfomiatiOn system that Incorporates both 
quality and managerial information will be essemial. Tocjfay we 
have two largely ^|>arate giou^>s— the faculty dominated program 
review committees concerned with quality and the institutional 
researchers providing budgetiiiy and managerial data to central 
admlnistratx)rs and external agencies." The challenge Is fbr adnttnl- 
strators to establish an evaluation system ttiat simultaneously Incor- 
porates the realities of fiscal management and protects tlie unique- 
ness ttf the Institution so that quality and etfectiyer tess art? more than 
cost figures related to production, • . 
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